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This paper proposes the use of specific coaching strategies to facilitate students' use of expert- 
like problem-solving strategies while analyzing and solving instructional design case studies. Findings 
from an exploratory study, designed to examine changes in students' problem-solving skills as they 
analyzed case studies, suggested that students could show expert characteristics at times, under some 
circumstances, but did not perform like experts on a regular basis. Thirty-seven students at two 
midwestem universities analyzed six to ten case studies as part of their course assignments. Both 
quantitative and qualitative data were collected; students' written case analyses (initial 
conceptualizations and recommended solutions) served as the primary data source. Comparisons were 
made both within- and across-students, as well as across time, to examine patterns and changes in 
students' problem-solving approaches. Findings suggested that primary influences on the incidence of 
expert performance seemed more external than internal and might be more aptly characterized as 
"coached expertise." Specific suggestions are included for coaching the development of students' 
problem-solving skills within a case-based course. 

Professional educators face a dauntirg challenge- preparing students to solve the kind of 
complex, ambiguous problems that they will encounter as practicing professionals. Unfortunately, we 
aren’t always successful in meeting this challenge. For example, in a study by Dahlgren and Pramling 
(1985), physicians noted the need to reorganize what they learned in medical school from a focus on 
content areas to a focus on common clinical problems. In addition, engineers and business 
administrators noted that the theories they learned in school were often too simplistic to help in solving 
real-life problems. Julian, Larsen, and Kinzie (1999) lamented that “novice (instructional) designers 
frequently enter the workforce with an understanding of the ID process but without the knowledge base 
that can help them solve instructional design problems and develop solutions” (p. 2). 

Increasingly, professional educators have turned to the use of cases in an effort to help 
students learn to approach problem situations in the same ways that practicing professionals do. Case- 
based instruction presents students with a re-creation of a complex situation (a case) and asks them to 
analyze and solve the problems through reflection and discussion (Allen, Otto, & Hoffman, in press). 
In case-based instruction the learning focus shifts from the explicit knowledge and skills that form the 
traditional academic curriculum to the development of active knowledge - what Whitehead called 
“wisdom” ( 1 929). Active knowledge goes beyond simply recalling information to the ability to use that 
information to select relevant issues and solve identified problems. For example, students in law school 
will read a case study and participate in a dialogue designed to elicit the key issues and legal principles 
in the case. More than simply recalling information, the students are asked to analyze the situation as a 
practicing lawyer would (Williams, 1992). Similar methods have been used in both business and 
medical education for nearly 100 years (Albanese & Mitchell, 1993; Christensen, 1987). 

Case-based instruction offers a number of advantages for professional education. Cases are 
thought to be more effective than didactic teaching methods because they (1) more accurately represent 
the complexity and ambiguity of real-life problems, (2) provide a framework for making explicit the 
problem-solving processes of both novice (student) and expert (instructor), and (3) provide a means for 
helping students develop the kind of problem-solving strategies that practicing professionals use. More 
specifically, case-based instruction can help students learn to: 

• Focus on the big picture. Expert problem-solvers typically represent a problem in terms of 
an appropriate underlying principle while novices tend to represent the problem in terms of surface 
features (Bruer, 1993). In case-based instruction, knowledge is embedded within complex and ill- 
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structured problems. As a result, students have an opportunity to practice “spotting” the underlying 
issues and principles in authentic, relevant problems. 

• Work forward from wh at they know. Experts often build on what they know, generating 
hypotheses and looking for information to test those hypotheses (Johnson, 1988). In contrast, novices 
tend to focus on what they don’t know, looking for information to fill in the gaps. A case study, by 
necessity, presents an abbreviated view of a problem situation. Students are forced to do the best they 
can with the information that is available. Thus, they learn to frame problems in ways that will move 
them forward toward a solution. 

• Simultaneously consider multiple factors. Experts are likely to consider the web of 
relationships and interactions that exist in the problem situation, while novices generally consider one 
factor at a time (Perez & Emery, 1 995). Cases allow students to experience the “complex and dynamic 
forces” (Rowland, 1992) that operate within the kind of complex problems that professionals 
commonly encounter. Although individual students may initially focus on a single factor when 
analyzing a case, case discussions tend to bring all of these factors to the table. This, then, facilitates 
consideration of all factors in an interdependent manner. 

• Generate tentative solutions. Both experts and novices generate solution ideas early in the 
problem-solving process. However, experts are more likely to modify or eliminate those solutions as 
additional information becomes available (LeMaistre, 1998). Case studies tend to involve more than 
one key player, each representing a unique perspective. With practice, students can begin to understand 
that each player has a legitimate voice. Students are encouraged to modify their initial solutions as 
information accumulates and different perspectives are heard, including the student’s own perspective. 

• Consider potential consequences and implications. Experts think through their 
recommendations more thoroughly than novices, considering how those recommendations might be 
implemented and what implications they might have (Rowland, 1 992). As a part of the case discussion, 
students are asked to consider the consequences of their recommended solutions and to select the one 
with the greatest benefits and smallest risk. Students and instructors are encouraged to evaluate each 
other’s recommendations and to challenge decisions based on their assessment of the consequences for 
all case players. 

Case-based instruction seems to be a natural fit with professional education in the field of 
instructional design. Like other professions, instructional design is a problem-solving enterprise in 
which practicing professionals combine creativity with technical skills to solve complex, ambiguous 
problems. Also like other professions, instructional design educators are looking to bridge the gap 
between education and practice (Quinn, 1994; Rowland, Parra, & Basnet, 1995) using a variety of 
methods, including case-based instruction (Ertmer & Quinn, 1999). According to Julian et al. (1999), 
case studies can help instructional design students (1) draw connections between their emerging 
knowledge of instructional design and the complex demands of practice, (2) reflect on relevant theory 
and methods as they explore a greater number of design issues in a broader array of contexts, and (3) 
broaden their knowledge base as they collaborate with colleagues to identify effective design solutions. 

In order to take advantage of the perceived strengths of case-based instruction, the authors 
developed an instructional design course in which the use of cases comprised the primary instructional 
method. Our original purpose was research. We planned to examine changes in students’ problem- 
solving skills during a course in which case-based instruction was used. However, after several 
different offerings of the course, we found that we had learned more about our use of cases than about 
changes in students’ problem-solving skills. That is, the changes in our a pplication of case-based 
instruction appeared more substantial than changes in students’ problem-solving approaches. 
Furthermore, as we continued to modify and refine our case discussion strategies, we began to identify 
techniques that seemed better able than others to facilitate more “expert-like” responses among the 
students. Thus, we began to consider ways in which we might more purposefully “coach” our students 
as they developed their problem-solving skills. 

The purpose of this paper, then, is to describe our evolving use of case-based instruction 
within an instructional design course. Recognizing that few guidelines exist for how to coach the 
development of students’ problem-solving skills using case-based instruction, this paper offers an 
initial set of recommendations, based on data gathered during three semesters of instruction (five 
different courses). The first section of the paper describes the context in which case-based instruction 
was situated, including the courses and the use of cases. The second section offers a set of guidelines 
for using cases as an instructional method in the education of instructional designers. Specifically, we 
present guidelines intended to help students use and develop the kind of problem-solving strategies 
commonly used by experts. 
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Context 



In the spring of 1998, the first two authors co-taught an advanced instructional design course 
at a large midwestem university. One faculty member was serving in a visiting position while on 
sabbatical leave from another institution. The following two spring semesters (1999 and 2000), both 
instructors taught similarly structured courses at their respective universities. During the spring 2000 
semester, the two courses shared a course Web site that allowed students to participate in shared 
electronic discussions. 

Participants (n=37) were enrolled in advanced graduate (n=25), introductory graduate (n=7), 
or advanced undergraduate courses (n=5) in instructional design. All but one student volunteered to 
participate in the study. Two undergraduate students were dropped from the study due to incomplete 
data sets. Course assignments and procedures were the same for participants and non-participants. 

Graduate students were enrolled in either an advanced instructional design course within an 
educational technology program or an introductory course within a human resource development 
program. Students in the advanced course had taken 0-7 previous instructional design courses. 
Although an introductory instructional design course was listed as a prerequisite, three students were 
admitted without the introductory course, having gained sufficient foundational knowledge from 
previous work experiences. Graduate students ranged in age from 24-51 years, with an average age of 
35 years. Undergraduate students were enrolled in the second instructional design course within a 
human resource development program. Undergraduate students ranged in age from 21-24 years, with 
an average age of 23 years. 

Students in all three courses had a variety of background experiences including retail sales, 
office work, classroom teaching (junior high, high school, community college, university), nursing, 
course development, engineering at a local manufacturing plant, and training (formal, informal, one- 
on-one settings). In general, undergraduate students had less course work and fewer relevant job 
experiences than the graduates. 

Procedures 

Students in each course analyzed six to ten instructional design cases as part of their course 
assignments. Case studies were drawn from Ertmer and Quinn (1999) and were used in conjunction 
with other activities (guest speakers, student presentations, project assignments, required readings) 
throughout the semester. There were no assigned textbooks in the advanced graduate course, although 
additional readings were frequently recommended or required. The introductory graduate course 
included an instructional design book by Smith & Ragan (1999) and the undergraduate course used a 
text by Kemp, Morrison, and Ross (1996), 

Students in each course also completed: (1) an open-ended questionnaire describing previous 
experiences with instructional design and with cases, and (2) a self-assessment survey indicating levels 
of competency from 1 (weak) to 5 (strong) on sixteen instructional design skills. The self-assessment 
survey was based on the sixteen instructional design competencies outlined by the International Board 
of Standards for Training, Performance, and Instruction (IBSTPI, 1984). Students rated their current 
level of knowledge and skill on items such as: assess the relevant characteristics of leamers/trainees 
(#3), develop performance measures (#7), evaluate instruction/training (#11), and promote the use of 
instructional design (# 1 6). At the end of the semester, the self-assessment surveys were readministered 
to all participants. 

Students participated in case discussions both in class and on-line. On-line discussions were 
facilitated via a listserv (spring 1999) or a Web-based bulletin board (spring 2000) and typically 
preceded the in-class discussions. While the listserv discussions extended dialog among the advanced 
ID students only, the Web-board discussions included students enrolled in both introductory and 
advanced courses at the two universities. Various techniques were used to initiate and facilitate the 
discussions including debate, role-play, and structured discussion. Regardless of technique, each 
discussion revolved around one or two basic tasks: (1) analyzing the problems and issues in the case 
and (2) recommending solutions for identified problems and issues. 

Qualitative analysis methods were used to examine changes in students' case responses. 
Responses initially were coded using the five expert problem-solving characteristics (see pages 4-5), 
but modified to fit emerging themes and patterns. For example, initial codes were used to characterize 
students' conceptualizations of the case (reporting vs. interpreting!, searches for information fabsent vs. 
present information), attention to the relationship among factors (laundry list vs, coherent plan!. levels 
of commitment to solutions (dictatorial vs. advisory), and consideration of the implications of 
recommendations (narrow focus vs. broad focus). 
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These codes were refined throughout data analysis and eventually combined into analysis and 
solution categories (see Appendix A for more detailed descriptions). Recognizing that problem-finding 
and problem-solving are two related, but different, skills, we examined students’ analysis and solution 
approaches separately. We examined students' analysis approaches by looking at their 
conceptualizations of the issues, searches for information, and attention to the relationships among 
issues. We examined students' solution approaches by looking at their attention to the relationships 
among solutions, levels of commitment to proposed solutions, and consideration of the 
impact/implications of proposed solutions. 

We assigned an independent rating to each student's analysis and solution response. If most of 
the components of a response were novice-like, the response was rated as "weak." If the response 
included a fairly equal number of novice and expert-like characteristics, it was rated as "mixed." 
Finally, if most of the components of the response were expert-like, the response was rated as "strong." 
This allowed us to 1) compare, within- students, analysis and solution approaches, 2) identify patterns 
of responses, across-students, that were specific to each case study, and 3) to identify patterns that 
developed or changed across-time. 

Results 

A two-tailed paired t-test (df = 36) indicated a significant increase in students’ ratings of 
perceived competency for instructional design skills ( t = 8.30; p < .000 1 ) from the beginning to the end 
of the semester. Even though all 1 6 skills were not specifically addressed in the case studies used in the 
courses, students judged that their competencies had increased across skills (pre-test mean = 3.44, SD = 
.36; post-test mean = 4.15, £D =.21). However, this increase in perceived competency was not 
completely supported by corresponding changes in students’ approaches to analyzing cases and 
recommending solutions. In general, students showed both strong and weak responses throughout the 
semester. In fact, sometimes students demonstrated a stronger response on an earlier case and weaker 
response on a later case. For example, when students’ attention was directed to the potential 
implications of a solution, students were able to consider the effects of their recommendations, but they 
did not always do so on their own. As another example, when students were specifically asked to 
classify one or several issues in a case, their conceptualizations tended to take on a “big picture” 
approach. In contrast, if asked to simply describe the issues, students tended to respond with more 
surface-level reporting. 

As we began to consider potential reasons for the uneven development and/or demonstration 
of students' problem-solving skills, oir research focus shifted from an emphasis on what students could 
or could not do, to what we, as the instructors, did or did not do in our role as coaches. In an attempt to 
explain our "uneven" results, we reexamined our on-line case discussions to identify if, and how, 
specific coaching strategies may (or may not) have supported students’ performances relative to each 
of the five characteristics of expert problem-solving. 

In the section that follows we describe the specific coaching strategies we used to i nitiate the 
on-line case discussions during spring, 2000. Although we recognize that coaching can, and does, 
occur throughout a case debriefing, our discussion here focuses primarily on the case set-up as a critical 
starting point. Specifically, we examined the extent to which two expert problem-solving 
characteristics (conceptualizing the issues in the case and considering the impact of recommended 
solutions) were facilitated by the use of specific coaching strategies. Given the preliminary nature of 
these analyses, we judged that these two characteristics offered a useful starting point. First of all, 
these categories were fairly well defined and, thus, made identification and classification of students' 
responses more reliable. In addition, the two c ategories comprised both an analysis and a solution type, 
which we still considered to be relatively distinct aspects of the problem-solving process. In the next 
section, we describe students’ responses to five different case set-ups: (1) structured discussion, (2) 
debate, (3) reflective practitioner, (4) role play, and (5) discussion chain. Each technique is considered 
in turn. (Note: Throughout the following discussion, participants in the ID courses are referred to as 
"students", whereas those who are receiving instruction within the case narratives are referred to as 
"learners.") 

Structured Discussion 

We used a structured discussion to initiate the on-line discussion for the Frank and Semra 
case. In this case, two U.S.-based instructional designers are faced with the challenge of developing a 
new curriculum to teach instructional design to trainers who work for the government of a southeastern 
Asian country. To begin, the instructors provided a one-sentence summary of the case, followed by 
three specific questions: (1) what do you think the learners’ expectations of the new curriculum will be, 
(2) what kinds of adjustments do you think the learners will have to make, and (3) how might you 
facilitate these adjustments? Students were not asked, specifically, to discuss either the underlying 
issues in the case or the impact of their solutions. 
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Conceptualization of the case issues . As the first on-line discussion of the semester, this 
discussion starter seemed to lead to fairly structured responses. Almost every student (16 out of 1 8) 
answered each of the three questions, one by one. Perhaps because this set of questions seemed so 
structured, most of the students ( 1 0 out of 1 6) started by reporting or summarizing the facts in the case. 
However, even though students' primary focus seemed to be on reporting, 12 students included an 
interpretation of the case events, either separately or in conjunction with fact reporting. [“The learners 
need to see a need for change before they buy into a new system of design ."] ["This is similar to a 
change initiative."] 

Interestingly, our efforts to help students broaden their initial conceptualizations met with 
little success. Questions we asked during the discussion to explore the identified issues ["What is it 
about the culture issue that Frank and Semra should adjust to?"] did not generate any direct responses 
from the students. However, when another student asked whether the case provided sufficient reason 
to believe that a change should be made in the training methods being used (a common 
recommendation), other students added new interpretations of the issue ["Who is the client here? Who 
has the right to decide what is or isn't appropriate?"]. This difference in students' responses to 
instructors and peers may have been related to the timing of the case. As the first case, students may 
have felt some discomfort with this type of on-line environment or with responding to the instructors as 
participants in the discussion. 

Students' considerations f the impact of recommendations . The three questions that opened the 
discussion asked students to make recommendations but did not ask them to explain the impact or 
implications of those recommendations. Additionally, the instructors asked few follow-up questions 
during the discussion and those that were asked generally focused on recommendations rather than 
implications [“Any thoughts about what Frank and Semra might do to make sure that it goes well with 
these trainers?”]. In retrospect, there were opportunities during the discussion to ask the students to 
explore implications (perhaps using questions such as "What effect might that have on the current 
trainers?") but, unfortunately, we failed to take advantage of these opportunities. 

Predictably, students provided recommendations, often stated in specific terms [“I should 
convince them that the system approach is effective.”] [“ I will look for new or young trainers.”]. 
However, there was little consideration of the implications of those recommendations. When students 
did consider implications, they were typically limited to a narrow focus on how a recommendation 
would solve the identified problem [“Once the interactive atmosphere is established, the losing face 
problem will not exist anymore.”]. Little apparent thought was given to the broader impact of a 
recommendation, such as how it might affect other participants within the case or fit with other 
recommendations. 

Debate 

For the second case we facilitated an on-line debate. The Denny Clifford case is about a 
design consultant, with a traditional instructional systems background, who is hired by a science 
educator to create constructivist learning materials. As part of the set-up for this discussion, the 
instructors provided the following conceptualization: "This case raises some important questions about 
working with clients who view things quite differently from us." Students were then asked to argue 
whether or not an instructional designer should accept such an assignment. Students were assigned to 
one of the two positions and encouraged to engage in some "friendly competition." 

Conceptualization of the case issues . In response to this set-up, almost every posting 
represented a conceptualization of why Denny should or should not take this job. Students were forced 
to support their positions, which led to a variety of sub-conceptualizations of the issue. Some students 
argued in terms of "comfort" or "stress" issues; others argued in terms of "risk," "challenge," or 
"growth possibilities." Because of this set-up, few students felt the need to cite facts from the case. 
Almost every student interpreted the case from the point of view they were assigned. The debate-style 
set-up seemed to be an effective way to get students to think beyond the facts of the case to the positive 
and negative sides of an issue. In addition, by providing a primary issue to chew on, the instructors 
modeled how to conceptualize issues in a case. 

Studentslxonsideration of the impact of recommendations . The debate format appeared 
somewhat successful in helping students focus on implications, especially among students who argued 
the “yes” position. Students explored implications from both a present and future perspective. In terms 
of present implications, some students noted that accepting the assignment would require additional 
work for both designer and client [“He may need to do a little extra work.”] [“She may have to play a 
larger role in the process . . .”]. Other students included suggestions for increasing the likelihood of 
success on the assignment [“Perhaps Denny needs to talk to the people using Oakes’ methods and find 
out how they are actually using them.”] [“First, he can begin by identifying the aspects that he has in 
common with Oakes . . .”]. In terms of ftiture implications, some noted that accepting the assignment 
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would help the designer develop his career [“Working with Oakes ... could open up even more doors 
for him to design for others and get him more jobs.”] [“If he begins to limit his range of content and 
philosophies as a designer, he will be compromising his career.”]. 

Reflecti ve Practitioner 

A reflective practitioner set-up was used with the Michelle Nguyen case. Michelle Nguyen is 
a designer/programmer working for a large medical center. She encounters a number of surprises as s he 
prepares to roll out a new product, carefully designed to reflect the requirements of a front-end analysis 
completed nine months earlier. In this type of case set-up, students were asked to assume the role of 
the instructional designer in the case, and, as a reflective practitioner, consider ’’lessons learned" from 
the specific experience. Rather than place blame on various stakeholders, students were encouraged to 
"move beyond" simply describing what happened to explaining at least one thing that would be 
important to do, or not do, the next time. 

Conceptualization of the case issues . A reflective practitioner set-up forced students to 
prioritize the important lessons learned from the case. This took them beyond facts to their own 
interpretation ofthe important issues. For example, some of the lessons learned included 1) the need 
for continual communication, 2) revisiting steps in the ID process as you go along, and 3) having a 
backup plan for dealing with problems. The lessons-leamed approach seemed to help students 
conceptualize the primary issues in the case in terms of important design processes and procedures. 

Consideration of the impact of recommendations . The students explored the implications of 
their original “lessons” more in this discussion than in previous discussions. In addition, the specificity 
ofthe instructors’ follow-up questions seemed to have an effect on the discussion that followed. For 
example, relatively general questions [“How do you think a focus group might have been helpful in this 
case?”] resulted in few responses from the students. In contrast, questions that were more specific 
[“But since a learner analysis had already been done, wouldn’t this slow down progress on the project . 
. .?”] resulted in a discussion that involved as many as twelve different responses from the students. 
Role Play 

In two different case discussions, students were assigned roles to play and asked to view the 
case from that person’s perspective. In the Haley Lawrence case, students were assigned a role and 
asked to “get inside that person’s head” and identify the issues and concerns of that one person. Haley 
Lawrence is a case involving a variety of stakeholders within a client organization. Although Haley is 
hired to help the organization develop training materials for their sales representatives, she encounters 
several people in the organization who appear uncertain about her role and who find her presence 
threatening. 

The Andrew Stewart case deals with the complexities and subtleties of integrating the 
contributions of different groups of stakeholders involved with a large design project. A secondary 
focus is on planning and completing a formative evaluation for a product that is still being developed. 
The case ends with the team in "crisis mode" as a deadline looms and the information collected, to- 
date, is unacceptable. In the Andrew Stewart case, students were assigned a role and asked to consider 
what they would do differently if they could start over and what they would do now, given the situation 
as it is. 

Students were more active in these two discussions, possibly because they had participated in 
several previous case discussions, but perhaps also because of the safety of playing a role. Students 
could express themselves more directly and emphatically because they were presumably expressing the 
views of someone else (a character in the case). One result is that both discussions included virtual 
arguments between role players. [“To be honest with you, Mr. Sumida, you’re changing the work 
contract on me.” “Ms. Lawrence, you were brought in the picture to solve a problem not to create new 
ones.”] [“It was not me who was trying to create new tasks. Instead I was trying my best to focus my 
tasks on our original contract.”] Students tended to stay in character throughout the discussion, often 
responding to one another in the first person. [“Why should these be my problems?”] [“Don’t put me in 
a bind.”] 

Conceptualization of the case issues . Despite an involved and intense on-line discussion, the 
Haley Lawrence role-play appeared only mildly successful at helping students frame and address 
design issues in the case. While students may have considered how one individual perceived the issues 
in the case, they did not work very hard, if at all, to understand each other's issues. Students enjoyed 
playing personalities, as noted earlier, but did not seem to move outside the personalities to consider 
broader case issues. However, in the students' defense, they participated in this discussion exactly as 
they were instructed. Had we encouraged them, sometime during the discussion, to switch hats with 
another stakeholder, we might have been more successful in moving beyond personalities to issues. 

The second role-play set-up was primarily solution-oriented. Although students were 
assigned roles to play, they were told, right from the beginning, that they all shared responsibility for 
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the current situation. Thus, students refrained from blaming others, and looked for ways to help 
salvage the situation. As the role players considered their own responsibilities in causing the situation, 
conceptualizations emerged ["I should not have involved a group that wasn't as motivated about this 
project as the others."] ["I think that the major flaw in what happened had to do with communication."] 
["I should have been more professional."]. 

Consideration of the impact of recommendations . Students did consider impact and 
implications in these discussions. On occasion, this included the practicalities of implementing 
suggestions that were made. [“You can have the St. Louis team send back the manuals on a weekly 
basis.”] Typically, however, this was limited to a narrow view of how suggestions made by others 
affected their own roles. [“Why should these be my problems?”] [“If you could show me a little respect 
. . .”] Students seemed to have difficulty stepping outside of their assigned roles to see the situation 
more broadly or to acknowledge the perspectives of the other role players. 

Discussion Chain 

For the Sandra Hernandez case, students were asked to structure their discussion in the form 
of a chain reaction. The Sandra Hernandez case describes how an instructional designer, Jake 
Spaulding, was asked to help Sandra "fix" problems she was having with her freshman engineering lab. 

In order to help Sandra, Jake must balance a number of contradictory requirements and work within 
numerous resource constraints. For this discussion, one of the instructors started by describing what he 
saw as the most important issue and then proposed a solution. Students then were instructed to either 
agree or disagree with a posted comment. If they agreed, they had to add something to the comment; if 
they disagreed they had to pose a counter argument. 

Conceptualization of the case issues . This type of set-up provided students with a model of 
how to conceptualize one issue in the case and then pose a relevant solution. By requiring students to 
add to each comment that they responded to, we forced them to consider other important issues that 
had been ignored or potential consequences of proposed solutions that had not been considered. 
Students looked for nuances in interpretation so that they could enhance or offer an alternative to a 
comment already posted. ["I don't agree that time is the main issue. I believe the main issue is what 
will be the best approach to teach the class.. .I'll consider time as one of many factors that are involved 
in the main issue."] Thus, conceptualizations were more complex than in previous cases, and evidence 
was typically provided to support specific conceptualizations. It is important to remember that this 
discussion occurred late in the semester, which may partially explain the increased complexity of 
students' responses. 

Consideration of the impact of recommendations . The “ground rules” inherent in this type of 
set-up encouraged the students to think more directly about the implications of posted solutions. They 
could agree or disagree with a recommendation, but only after giving it some thought - what benefits 
or limitations did they see. One result was that students seemed to take a relatively broad view of a 
recommended solution. Sometimes this took the form of adding suggestions about how to implement a 
solution. For example, one recommendation was to have the lab already set up for the learners. 
Students added their thoughts about how to make this work. [“I can see this happening with the classes 
being divided into two sessions.”] Sometimes it took the form of pulling in other issues. For example, 
another recommendation was to conduct the lab activities via computer simulation. Students discussed 
this solution in terms of cost [“Although this seems like a good solution, it’s expensive and time- 
consuming.”] [“If you cost out 80 students per semester, it would not take long to make this program 
cost-effective.”], access [“Are there computers available for all of the students to have access?”], and 
instructional methods [“From the case, it seems to me that the experiments are a very ‘hands on’ type 
of procedure. I think computer simulation is not good enough for this type of experience.”]. In order to 
agree or disagree with another person's comment, students had to carefully consider the many 
implications of a recommended solution. This, then, led to a fairly sophisticated understanding of the 
impacts of any single solution. 

Coaching Guidelines 

In general, students in our case-based courses perceived themselves as more competent at the 
end of the semester than at the beginning. However, the problem-solving strategies they used did not 
show the same kind of improvement. Students showed both strong and weak responses to cases 
throughout the semester, suggesting that their problem-solving expertise was not internalized. They 
could show characteristics of expert problem-solvers at times, under certain circumstances, but did not 
do so on a regular basis. The primary influences on their analysis and solution responses appeared more 
external than internal. 

One of the external influences on students' responses was the way the case discussion was set 
up by the instructors. In the previous section, we described the coaching strategies we used to initiate 
on-line case discussions and the results that followed their use. Specifically, we related these results to 
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two expert problem-solving strategies: ( 1 ) the ability to conceptualize situations in terms of underlying 
principles rather than surface details, and (2) the ability to consider the impact and implications of 
recommended solutions in broad, rather than narrow, terms. In this section, we abstract from these 
results several strategies that instructors can use to guide their own coaching efforts. We have 
purposely described the strategies in broad terms in order to present strategies that can be applied 
through various techniques to cases in a variety of content areas. Where possible, we illustrate the 
strategies with examples from our case-base courses. 

Co a ching S t udent s’ Co n cept ua l iza t io n of C ase Is sues 

Strategy 1: Structure the discussion byLgiving.students an initial role to ulay or a position to 
take in the discussion . In our case discussions we used debate, role-play, and reflective practitioner 
formats, all of which worked reasonably well as a way of implementing this strategy. Besides 
supporting students' conceptualization of the case issues, several other benefits appeared to result from 
using this strategy: 

Safety . Students can present observations and opinions within the context of the assigned role, 
and not feel like they are exposing their own views to disagreement, ridicule, or evaluation. For 
example, during the on-line discussion of the Haley Lawrence case we asked students to play one of 
five characters in the case and to describe how that person viewed the case situation including his/her 
issues and motives. Students used a variety of creative approaches to express the thoughts, feelings, 
and opinions of their assigned character. One student wrote in a stream of consciousness, which 
enabled other students to read this character’s innermost feelings and thoughts about the case. [“I can’t 
believe Sumida didn’t tell me about his task force and this list. Great, I see where this is going... When 
is Califano coming on board again? I can’t wait until then, okay schedule an appointment with 
Katz. Another student summarized her response in the form of a memo to another character. A third 
student set the scene and then began sharing his thoughts on the case by talking to himself [“Sumida 
was smoking his last cigarette before going to bed, while reviewing a chapter of Covey’s Seven Habits 
of Highly Effective People. He flipped over the open book on the table and he paused into thinking 
about his last meeting. The meeting scene was in front of his eyes, he started talking to himself and 
creating his own scenarios about the new project.”]. The safety of responding from the perspective of 
an assigned role appeared to give students permission to respond both boldly and creatively, without 
fear of being criticized by their peers. 

Starting point . The assigned role or position gives students some initial guidance and/or 
parameters that help them form their initial response. For example, when we began discussing the 
Denny Clifford case we asked students a single question: “The first question that needs to be addressed 
is whether it’s even possible to design instruction for someone whose philosophy is diametrically 
opposed to our own - and when we don’t really understand that other philosophy.” We then asked half 
of the students to “present reasons why Denny should not try to work with Cynthia” and the remaining 
students to “present reasons why Denny should be successful working with a client with a different 
philosophy.” The assigned position enabled students to engage in a lively debate as they argued both 
why Denny should take the job [“My opinion is that Denny Clifford should ‘say yes bravely’ to taking 
this job especially because he should remind himself that he is an independent consultant for a reason . 

. . that he must try to continually learn different philosophies of education so that he is able to innovate 
more instructional designs”] and why he should not take the job [“My position is that Denny Clifford 
should just say no to taking this job. He reminds himself that he is an independent consultant for a 
reason . . . that he can choose the jobs he wants to work on.”]. In addition, being assigned a position 
that one didn’t necessarily agree with encouraged students to consider strong arguments from both sides 
of the issue. This, then, provided them with a more complete view of the situation, allowing them to 
see that there were advantages and disadvantages to either decision the designer might make. 

Multiple perspectives . Assigning different roles within a single discussion helps ensure that 
the viewpoints of different key players within the case will be voiced. This results in a broader view of 
the case. Following this, additional questions can be posed to compare and contrast the 
conceptualizations or interpretations of the case represented by the multiple roles. Returning to the 
Haley Lawrence case, each student played the role of one of the five characters in the case, which 
meant that several students were playing the same role during the discussion. Therefore, each character 
in the case had at least one voice in the discussion. During the discussion, the instructors can also help 
students move beyond their own role to see the viewpoints of the other characters [“So what exactly do 
you think is motivating his actions? And how can Lawrence get through to him and everyone else)?”]. 
However, this may need to take the form of explicit directions, as the students in our courses did not 
seem inclined to do this on their own. 
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Strategy 2; Begin the discussion with a structure, but avoid rigid adherence to that structure . 
It’s important to remember that the instructor has two basic tasks in the case discussion: (1 ) setting up 
the discussion to create a dialog among the students and (2) facilitating the discussion to keep the 
dialog going. A flexible discussion structure helps with both of these tasks. 

Creating a dialog The case set-up helps to “prime the pump” by providing students with an 
initial shared framework for thinking about the case and expressing their thoughts. For example, in the 
chain-reaction approach used for the Sandra Hernandez case we started the chain by (1) making a 
statement, (2) asking an open-ended question, and (3) presenting a set of ground rules for the 
subsequent discussion. Specifically, one instructor began the chain: 1) “I think the biggest problem 
here is the students’ backgrounds. They just aren’t ready for this course. To solve this problem, I think 
Jake should find a way to simplify the content of the course so that it is more in line with the academic 
background of the students coming into the course. 2) What do you think? 3) If you agree, you must 
add to the posted comment in some way. If you disagree, you must offer an alternative of some kind.” 
By including both guidelines and an example of how to follow the guidelines, we jump-started the 
discussion and made it easy for others to jump in. 

Maintaining the dialog. Once the discussion starts and the ideas are flowing, the initial 
structure has served its purpose. In fact, students sometimes find it more constraining than facilitating. 
The instructor’s tasks at this point are to help the students find the connections among the points being 
made and relate their discussion to the “big picture” issues in the case. For example, during the 
discussion of the Denny Clifford case, one student suggested an analogy to support her point. There 
were different interpretations of the analogy, which lead to a digression in the discussion. One of the 
instructors’s maintained and refocused the dialog by looking beyond the analogy and posting a 
question. [“Christie’s comment brings up ... two good questions: (1) Do you have to understand a 
philosophy in order to design instruction to teach that philosophy; (2) Do you have to subscribe to the 
philosophy in order to design instruction to teach that philosophy?]. In maintaining the flow of the 
discussion, it's important to remember that we want students to do more than just 'talk'; our primary 
goal is to maintain a focused discussion that continues to address the issues in the case. 

Coaching Students' Consideration of Implications of Solutions 

Strategy 1: Ask specific questions and limit the number that you ask . During the initial set-up, 
it is possible to ask students to identify a problem, suggest a solution, and describe the possible impact 
of that solution. However, this may be too much for the initial set-up. It may be easier and better to 
explore these separately as the discussion progresses. When the initial set-up is too restrictive students 
do not have room to express their views and may feel that they are providing “answers” rather than 
discussing ideas. Once the discussion is going, however, students can more readily respond to specific 
questions about the impact of their recommendations on case stakeholders. Benefits of this strategy 
include: 



Prevents students from being overwhelmed . A multi-part initial question may overwhelm 
students, especially if it appears to require specific answers. For example, we began the discussion of 
the Frank and Semra case with three specific questions, described above. The students were slow to 
respond to these questions, reporting that they felt overwhelmed by the number of questions and that 
they were concerned about posting “correct answers.” In contrast, we began the discussion of the 
Andrew Stewart case by asking the students to discuss two questions from their character’s 
perspective: (1) If you had to do it over again, what would ysm. do differently? (2) Now that you’re in 
the pickle you are in, what will you do next? This technique enabled students to jump into the 
discussion without feeling like they were overwhelmed or had to come up with the right answer. A 
result was that students joined the discussion more quickly and freely [“I obviously should not have 
tried to involve a group that wasn’t as motivated about this project as the other participants...”] [“...If I 
had to do it over again, I suppose I should have reacted to my gut instinct when I saw the St. Louis 
team making faces. I’d forgotten how some designers think they know it all as soon as they land a nice 
paying job right out of school...”]. It is important to pay close attention to the manner in which a case 
discussion is opened; concern over "correct answers" is likely to stifle participation. 

Creates open dialog among students . Asking specific questions encourages students to 1) 
respond to one another’s problem identification, 2) suggest a solution to a problem described by 
someone else, or 3) describe the impact/implications of a recommendation made by someone else. For 
example, throughout the Sandra Hernandez case students actively responded to one another’s answers 
using the “chain-reaction” approach and offered alternative perspectives on the impact and implications 
of the case. Students often responded directly to a person and posed additional questions [“Your 
consideration about the limited budget available is nice, but how could students ‘collect data’ without 
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conducting real experiments or computer simulations?”] [“I still disagree. How will the students’ 
conduct the experiments if the equipment isn’t set up? Will the students still set it up? If they do then 
the diagrams may use even more valuable time when the students study them.”]. Having permission to 
disagree with each other's interpretations allowed for a rapid exchange of comments, each providing a 
new consideration of possible impacts. 

Strategy 2; Look for opportunities to ioiathe discussion, but participate carefully . As the 
discussion progresses, the instructor’s primary responsibility is to maintain the dialog. To do this, it’s 
important to continually look for opportunities to add questions and comments designed to help 
students see connections - to other students and to the big ideas that frame the case. At the same time, 
it’s important to monitor the possible effects that your input may have on students. Students sometimes 
perceive comments from the instructor as the “answer,” which may impede, rather than support, the 
dialog. In these situations, it is often better to resist the natural tendency to add your own, more expert 
views and let the students come to their own understanding of a case and its solution. Of course, this 
doesn’t mean that instructors should avoid participating in the discussion. It means only that instructors 
should be constantly aware of the potential effects that their participation may have. Benefits of this 
strategy include: 

Models expert responses . When the instructor models expert responses the students get a 
clearer picture of what is required of them. For example, in response to an ongoing discussion of the 
Michelle Nguyen case, one instructor wrote: “Playing devil’s advocate, even if Michelle had conducted 
monthly (or quarterly) meetings with Alex and Susan, she still may not have found out soon enough 
about the library hours not being sufficient. I mean when is soon enough when you’re creating CBI? 
And maybe the library hours aren’t the real issue.... So the question I have is- do you think this case 
primarily illustrates a front-end analysis problem or an implementation problem? Ideas, anyone?” This 
comment was an example of both considering the implications of a recommendation that had been 
made (monthly meetings) and looking for the underlying principle (Do you think this case primarily 
illustrates a front-end analysis problem or an implementation problem?). Also, by prefacing the 
comment with the warning, "playing devil's advocate," the students realize that their previous 
comments are not being criticized. In this way, students are encouraged to think about the issues in 
ways they previously hadn’t considered. 

Supports ongoing dialog The instructor’s comments and questions can also encourage 
students to elaborate their thoughts about a point raised in the discussion. Other students can, then, 
respond to the elaboration, thereby continuing the dialog. For example, during the discussion of the 
Haley Lawrence case, we commented on one student’s reaction by posing additional questions for 
students to explore. [“So what exactly do you think is motivating his actions? And how can Lawrence 
get through to him (and everyone else?)”] When instructors participate carefully, through questions 
and comments, students' problem-solving approaches may incorporate more expert-like characteristics, 
including the consideration of the impact of initial recommendations. 

Limitations 

We began this work with the idea of identifying patterns in the development of students’ 
problem-solving skills. What we found, however, was an absence of patterns and, over the course of 
several semesters, our focus shifted to examining the coaching strategies we were using. In the 
previous section, we suggested several broad strategies instructors can use to guide their coaching. The 
strength of these suggestions, however, is limited by several factors, including: (1) our analysis codes 
and categories may not have been sophisticated enough to find patterns in students’ problem solving 
skills, and (2) there may have been insufficient time for students' problem solving skills to develop. 
Both of these limitations provide opportunities for future research. 

One of the unstated goals of this investigation was to develop and apply an analysis 
framework for examining students’ responses to discipline -related case studies. The framework 
developed during this research, although greatly refined from its initial stages, must still be considered 
preliminary. Additional refinements are needed to allow consistent application while analyzing 
students’ case responses. 

The development of problem-solving expertise is known to take place over a long period of 
time. Trying to capture this development in a semester-long course is difficult, at best. Longitudinal 
studies are needed to determine if, and how, this process occurs over an extended period of time, and 
the extent to which instructors can influence that process through the coaching techniques they use 
during case discussions. Furthermore, it is important to determine the extent to which students who 
develop strong problem-solving skills within case-based courses actually transfer these skills to their 
future jobs. Does the experience of solving cases in a college course benefit instructional designers in 
their future practice? Further research is needed to address these important questions. 
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Conclusion 

Case-based instruction has been heralded as a powerful means for helping instructional design 
students bridge the gap between novice and expert practice (Julian et al., 1999). However, case-based 
instruction does have its risks. Students may like using cases and perceive that they have learned a lot. 
But this does not necessarily mean that they have gained new or better problem-solving skills that will 
help them become better instructional designers. Blumenfeld, Soloway, Marx, Krajcik, Guzdial, and 
Palinscar (1991) suggested that “without adequate attention to ways of supporting students and 
teachers, leaming-by-doing will not be done” (p. 374). Case-based instructors need effective strategies 
for supporting students during case study analysis. If not used well, cases may merely perpetuate the 
approaches and strategies that students already use. Clearly, teaching with cases is not an easy task. 

As noted by McNergney (1999): "Teaching and learning with cases is not for the faint of heart" (p. vi). 

Sykes and Byrd (1992) stated that “learning from cases will depend on the interaction among 
what the case presents, what the reader brings, and what the teacher does with the case” (p. 5 1 1 ). J. 
Shulman (cited in Lundeberg, Levin, & Harrington, 1 999, p. 1 5) expressed the importance of 
discussion and facilitation when she noted, "cases, even with commentaries, do not teach themselves." 
The role of the coach (instructor) is viewed as being critical to the success of the entire process. Yet, 
there are very few guidelines available for instructors who wish to begin using a case-based approach. 
With little guidance, instructors can easily fall into the trap of thinking that just because case 
discussions are interesting and engaging, that students are learning the things they need to learn to 
become better designers. 

Through our ongoing examination of students' responses to the use of cases, we have 
identified techniques that appear effective in eliciting students’ use of effective problem-solving 
strategies. Although our results are preliminary, this work addresses two important questions about the 
effective use of cases in instructional design courses including: 1) what to assess as evidence of 
students' learning in a case-based course and 2) how to achieve specific learning outcomes (e.g., 
increase in problem-solving skills) through the use of specific coaching strategies. To date, little work 
has been done to actually measure changes that occur in students' problem-solving skills through 
participation in a case-based course. Even less work has been done to tie specific coaching strategies to 
the attainment of those outcomes. This work represents the first step in addressing these important 
issues. Still, we realize that there is much more to learn. We plan to continue to examine specific 
coaching strategies that facilitate student problem-solving within case-based instruction. In addition, 
we plan to continue to hone our analysis skills so that we can more readily examine the effectiveness of 
different coaching strategies on the development of students' problem-solving skills. Ultimately, by 
refining our case-coaching strategies, we hope to increase the potential of case-based instruction to 
facilitate the development of expert problem-solving skills in our instructional design students. 
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Appendix A: Descriptions of Coding Categories 

1 . Conceptuali zi ng t h e iss ue s (reporting vs. interpreting) 

When confronted with a “messy” problem situation, novices are likely to report or summarize 
the issues, as they are described in the case. The report is often verbatim and appears to take the 
problem(s) presented in the case at face value with little apparent effort to consider the extent to which 
the presented problems are at the “heart” of the case. The result is a simple recounting of issues, as 
others see them, that often remains at a superficial level. 

Experts are less likely to take the presented problem at face value. Instead, they will use their 
own experience to inform their view of the case and to reframe the problem, often using their own 
words. Experts are more likely to identify the “central” issue in a case or to categorize or prioritize the 
issues in some way, often including an explanation of the principle underlying the priorities. The result 
is an interpretation of the case that is often unique and specific to the situation. 

2. Building on what is known (absent information vs. present information) 

When confronted with an ill -defined problem, both novices and experts recognize that they 
have incomplete information. However, novices tend to focus on what they don't know and to ask 
questions designed to fill the perceived information gaps. In doing so, they seem to lose sight of what 
they do know, suggesting that a great deal of additional information is necessary before a solution can 
be developed. In addition, their approach to information gathering often seems scattered. That is, they 
suggest additional information without apparent consideration for the specific purpose or value of that 
additional information. 

In contrast, experts more often focus on what they do know. They will make inferences based 
on available information and consider scenarios that are likely to emerge as more information is 
obtained. In addition, they tend to take a more focused approach to information gathering. That is, they 
will look for specific information that will help confirm or refute their interpretations or assess the 
effectiveness of their proposed solutions. 

3. Attending to the relationships among factors (laundry list vs. coherent plan) 

Both novice and expert problem solvers are likely to consider multiple factors in a case. 

However, novices often take a “laundry list” approach to both identifying problems and proposing 
solutions. With problems, this often takes the form of lists of issues (sometimes long lists) that are 
presented as separate items. There is little apparent consideration for how the issues might be related, 
perhaps as parts of a larger issue, and little apparent effort to organize the list. With solutions, this often 
takes the form of a list of suggestions, again presented as separate items with little apparent 
consideration for the relationships that might exist among the suggestions. In both cases, the result is a 
piecemeal collection of ideas that lacks apparent coherence or coordination. 

In contrast, experts are more likely to have a coherent plan. They may identify multiple issues, 
but are more likely to make explicit links among those issues. Similarly, they may suggest multiple 
solutions, but link the suggestions together in a coordinated effort to solve the problem(s). 

4. Considering solutions in tentative terms (dictatorial vs. advisory) 

Both novice and expert problem solvers are solution oriented and often propose solutions 
early in the problem-solving process. However, they will do this in different ways. Novices often 
propose solutions in a dictatorial manner (you must . . ., you should. . .). They are likely to take a 
judgmental position, often criticizing or finding fault with one or more key players in the case. In 
addition, once proposed, their suggestions are often “carved in stone.” As new information becomes 
available, novices tend to stand by their original suggestions. Rather then modifying their suggestions, 
they often find ways to justify them in spite of the new information. 

In contrast, experts recognize that the available information is incomplete and that there are 
multiple ways to address the different issues. As a result, they are likely to take an advisory tone when 
making suggestions (you might..., perhaps you could...). They are more likely to take an empathic 
position, explaining possible reasons behind the actions of the key players in the case. And they are 
more likely to modify or eliminate proposed solutions new information becomes available. 

5. Considering the impact/implications of proposed solutions (narrow focus vs. broad 

focus) 

Both novices and experts frequently suggest solutions to the problems identified in a case. 
Novices make suggestions without apparent regard for how those suggestions might be implemented or 
what effects they might have . That is, novices typically do not include overt consideration of impact 
and implications in their write-up of a case. When they do consider impact/implications, it is limited to 
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a narrow focus on resolving the identified problem. This takes the following form: The problem is . . . 
What I would do is ... That would solve the problem by . . . 

In contrast, experts typically think through their suggestions, explicitly considering how those 
suggestions might be implemented and/or what effects they might have. In addition, their consideration 
of impact/implications is broader. It often goes beyond a straight-line focus on problem and its 
immediate solution to consider other issues that may be important (e.g., cost, time, reactions of key 
players). 
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